Skip to main content

Survey Crawls

Survey crawls are run about twice a year, on average, and attempt to capture the content of the front page of every web host ever seen by the Internet Archive since 1996.

83,791
RESULTS
rss


PART OF
Internet Archive Web Crawls
Media Type
14
collections
83,777
web
Year
5,174
2018
13,441
2017
14,424
2016
20,654
2015
12,579
2014
13,561
2013
More right-solid
Topics & Subjects
83,777
crawldata
2
webcrawl
1
net
1
webwidecrawl
Collection
More right-solid
Creator
83,048
internet archive
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
collection
eye 706.1M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
collection
eye 449.3M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
collection
eye 299.5M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
collection
eye 263.3M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
collection
eye 228M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
.com survey started January 2011
collection
2,535
ITEMS
156.8M
VIEWS
collection
eye 156.8M
Survey crawl of .com domains started January 2011.
Topic: webcrawl
collection
eye 30.2M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
Survey Crawl Number 6: Sep 11th, 2017 - running now
collection
13,705
ITEMS
28.3M
VIEWS
collection
eye 28.3M
The seed for this crawl was a list of every host in the Wayback Machine This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
COM Survey Crawl 2009-2010
collection
729
ITEMS
28M
VIEWS
collection
eye 28M
COM survey crawl data collected by Internet Archive in 2009-2010. This data is currently not publicly accessible.
survey_net00000
collection
300
ITEMS
19M
VIEWS
collection
eye 19M
Survey crawl of .net domains started December 2010.
Topic: webcrawl
ORG Survey Crawls
collection
191
ITEMS
11.6M
VIEWS
collection
eye 11.6M
Survey of .org domains. This data is currently not publicly accessible.
survey_net00001
collection
165
ITEMS
8M
VIEWS
collection
eye 8M
Survey crawl of .net domains started October 2011.
Topics: webwidecrawl, net
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl428.us.archive.org:survey from Thu Jan 8 02:39:52 PST 2015 to Thu Jan 8 02:17:55 PST 2015.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl835.us.archive.org:survey from Sun Jan 10 18:55:42 PST 2016 to Sun Jan 10 11:20:26 PST 2016.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl420.us.archive.org:survey from Mon Dec 23 10:49:15 PST 2013 to Mon Dec 23 05:58:22 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Sun Jan 25 16:21:37 PST 2015 to Sun Jan 25 09:51:07 PST 2015.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl429.us.archive.org:survey from Fri Jan 17 02:48:53 PST 2014 to Thu Jan 16 23:21:44 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl336.us.archive.org:survey from Fri Jan 17 01:34:59 PST 2014 to Thu Jan 16 20:57:28 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl422.us.archive.org:survey from Sat Dec 20 22:29:58 PST 2014 to Sat Dec 20 16:52:21 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl454.us.archive.org:survey from Thu Dec 12 08:45:40 PST 2013 to Thu Dec 12 01:43:13 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl804.us.archive.org:survey from Mon Feb 22 06:57:25 PST 2016 to Mon Feb 22 01:01:29 PST 2016.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl419.us.archive.org:survey from Thu Jan 16 23:17:39 PST 2014 to Thu Jan 16 20:04:33 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl423.us.archive.org:survey from Sun Dec 21 20:51:55 PST 2014 to Sun Dec 21 16:00:10 PST 2014.
Topic: crawldata
.com survey started January 2011
web
eye 764,066
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl309.us.archive.org:com from Wed Feb 23 14:38:26 PST 2011 to Wed Feb 23 08:38:53 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl416.us.archive.org:survey from Sun Dec 29 12:12:47 PST 2013 to Sun Dec 29 06:16:27 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl429.us.archive.org:survey from Sun Dec 29 14:04:04 PST 2013 to Sun Dec 29 07:52:39 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl335.us.archive.org:survey from Thu Jun 5 00:24:07 PDT 2014 to Wed Jun 4 22:31:50 PDT 2014.
Topic: crawldata
Survey Crawl Number 7
collection
2,381
ITEMS
706,979
VIEWS
collection
eye 706,979
This "Survey" crawl was started on Feb. 24, 2018. This crawl was run at a level 1 (URLs including their embeds, plus the URLs of all outbound links including their embeds) The WARC files associated with this crawl are not currently available to the general public.
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Sun May 18 19:10:35 PDT 2014 to Sun May 18 13:22:44 PDT 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl429.us.archive.org:survey from Thu Feb 4 02:49:00 PST 2016 to Wed Feb 3 20:18:27 PST 2016.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl811.us.archive.org:survey from Wed Feb 24 03:27:27 PST 2016 to Wed Feb 24 01:58:44 PST 2016.
Topic: crawldata
.com survey started January 2011
web
eye 557,922
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl309.us.archive.org:com from Tue Feb 22 20:36:54 PST 2011 to Tue Feb 22 14:45:19 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl457.us.archive.org:survey from Thu May 14 12:28:39 PDT 2015 to Thu May 14 06:26:41 PDT 2015.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Tue Jul 23 20:44:16 PDT 2013 to Tue Jul 23 15:03:33 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl804.us.archive.org:survey from Fri Dec 19 15:17:43 PST 2014 to Fri Dec 19 08:41:03 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl336.us.archive.org:survey from Wed Jan 28 02:55:43 PST 2015 to Wed Jan 28 07:20:00 PST 2015.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl425.us.archive.org:survey from Tue Dec 30 01:55:11 PST 2014 to Tue Dec 30 00:46:52 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl838.us.archive.org:survey from Sun Jan 10 18:12:42 PST 2016 to Sun Jan 10 12:15:44 PST 2016.
Topic: crawldata
.com survey started January 2011
web
eye 446,892
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl309.us.archive.org:com from Sat Feb 12 04:25:02 PST 2011 to Tue Feb 22 12:28:53 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl428.us.archive.org:survey from Mon Dec 29 19:10:21 PST 2014 to Mon Dec 29 15:19:16 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Tue Dec 30 19:27:32 PST 2014 to Tue Dec 30 16:19:14 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl428.us.archive.org:survey from Mon Dec 29 15:42:02 PST 2014 to Mon Dec 29 11:10:21 PST 2014.
Topic: crawldata
Data crawled by Internet Archive on behalf of Internet Archive from Sat Jan 02 00:17:41 PDT 2010 to Sat Jan 02 00:40:59 PDT 2010
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl803.us.archive.org:survey from Mon Dec 29 16:24:24 PST 2014 to Mon Dec 29 16:12:36 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl338.us.archive.org:survey from Mon Dec 29 19:47:20 PST 2014 to Mon Dec 29 15:22:22 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl336.us.archive.org:survey from Mon Dec 29 17:40:49 PST 2014 to Mon Dec 29 13:50:46 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl426.us.archive.org:survey from Mon Dec 29 17:24:53 PST 2014 to Mon Dec 29 12:36:45 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl805.us.archive.org:survey from Mon Dec 29 17:33:28 PST 2014 to Mon Dec 29 15:25:11 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl804.us.archive.org:survey from Mon Dec 29 16:39:30 PST 2014 to Mon Dec 29 15:21:31 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl809.us.archive.org:survey from Mon Dec 29 20:07:14 PST 2014 to Mon Dec 29 18:18:25 PST 2014.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl419.us.archive.org:survey from Mon Dec 23 06:56:18 PST 2013 to Mon Dec 23 00:11:42 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl801.us.archive.org:survey from Mon Jan 26 09:41:07 PST 2015 to Mon Jan 26 15:41:07 PST 2015.
Topic: crawldata
.com survey started January 2011
web
eye 358,931
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl318.us.archive.org:com from Sun Feb 6 18:41:23 PST 2011 to Sun Feb 6 11:27:09 PST 2011.
Topic: crawldata
.com survey started January 2011
web
eye 357,658
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl309.us.archive.org:com from Fri Feb 25 11:29:38 PST 2011 to Fri Feb 25 05:14:47 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Fri May 31 21:15:22 PDT 2013 to Sun Jun 2 06:31:08 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl807.us.archive.org:survey from Sat Dec 20 02:45:20 PST 2014 to Fri Dec 19 20:48:27 PST 2014.
Topic: crawldata
Data crawled by Internet Archive on behalf of Internet Archive from Sat Jan 02 00:42:27 PDT 2010 to Sat Jan 02 01:13:48 PDT 2010
Topic: crawldata
.com survey started January 2011
web
eye 334,567
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl316.us.archive.org:com from Fri Jan 28 20:46:35 PST 2011 to Fri Jan 28 13:19:27 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl451.us.archive.org:survey from Sat May 25 23:20:37 PDT 2013 to Sun May 26 23:08:39 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Sun May 26 01:33:43 PDT 2013 to Mon May 27 01:54:34 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Wed May 22 00:29:45 PDT 2013 to Wed May 29 10:38:37 PDT 2013.
Topic: crawldata
ORG Survey Crawls
web
eye 320,628
favorite 0
comment 0
Internet Archive crawldata from wikipedia outbound links. captured by crawl444.us.archive.org:surveyorg from Wed Jun 22 19:36:32 PDT 2011 to Wed Jun 22 20:01:50 PDT 2011.
Topic: crawldata
.com survey started January 2011
web
eye 320,468
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl318.us.archive.org:com from Mon Feb 7 05:11:06 PST 2011 to Sun Feb 6 23:13:41 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl451.us.archive.org:survey from Thu May 30 07:48:07 PDT 2013 to Fri May 31 01:05:49 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl451.us.archive.org:survey from Mon May 27 06:08:39 PDT 2013 to Tue May 28 14:16:34 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl451.us.archive.org:survey from Fri May 31 08:05:49 PDT 2013 to Sat Jun 1 10:43:44 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Wed May 29 17:38:37 PDT 2013 to Thu May 30 11:17:05 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl453.us.archive.org:survey from Tue Jun 18 10:36:57 PDT 2013 to Fri Jun 21 09:04:08 PDT 2013.
Topic: crawldata
.com survey started January 2011
web
eye 307,748
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by crawl309.us.archive.org:com from Fri Feb 25 09:39:09 PST 2011 to Fri Feb 25 03:27:27 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Fri May 31 11:37:10 PDT 2013 to Sat Jun 1 18:34:32 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl451.us.archive.org:survey from Sat Jun 1 17:43:44 PDT 2013 to Sun Jun 2 20:36:52 PDT 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl457.us.archive.org:survey from Thu Dec 26 02:32:43 PST 2013 to Wed Dec 25 20:37:35 PST 2013.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Wed May 29 01:12:44 PDT 2013 to Thu May 30 03:35:17 PDT 2013.
Topic: crawldata
.com survey started January 2011
web
eye 304,612
favorite 0
comment 0
Internet Archive crawldata from COM zone survey, captured by ia360919.us.archive.org:com from Thu Feb 3 10:42:48 PST 2011 to Thu Feb 3 03:38:09 PST 2011.
Topic: crawldata
Internet Archive crawldata from Survey Webwide Crawl, captured by crawl452.us.archive.org:survey from Mon May 27 08:54:34 PDT 2013 to Tue May 28 18:12:44 PDT 2013.
Topic: crawldata